Smart Fridge with AI Applications

Nuvoton offers a wide range of advanced MEMS motion, environmental sensors, and wired and wireless connectivity to help design connected, energy-efficient, user-friendly refrigerators and freezers. By integrating Artificial Intelligence (AI) technologies, Nuvoton also enables smarter refrigerators and freezers that automatically recognize food types, monitor food freshness, and provide real-time feedback through mobile apps, offering users a more convenient user experience.

Applicable development boards  

NuMaker-HMI-MA35D1-S1

Smart Refrigerator Content Recognition and Management
Install a camera inside the refrigerator to capture the food and drinks.
The MA35D1 processes the image data from the camera, classifying the items in the refrigerator into categories such as fruits, vegetables, drinks, dairy products, etc., through advanced image recognition technology.

NuMaker-HMI-M467

NuMaker-IoT-M467

1. Vibration Detection

Example: Refrigerator Health Monitoring

Use a vibration sensor to monitor the operation of a refrigerator's compressor and other moving parts.
The Cortex-M4 processes the sensor data and analyzes the vibration patterns of the refrigerator to detect if it is operating normally.
Suppose the vibrations are outside the normal range, such as excessive or irregular. In that case, it indicates a potential fault, and the system prompts the user to inspect or service the appliance.



2. Sensor Fusion

Example: Comprehensive Environment Monitoring

Combine temperature, humidity, and door open/close sensors to monitor the environmental conditions inside a refrigerator.
The Cortex-M4 analyzes the combined data from these sensors to ensure that the temperature and humidity inside the refrigerator are maintained within optimal ranges and monitors the door's open/closed status.
When abnormal temperature/humidity is detected or the door is not closed correctly, the system generates alerts to help users address issues promptly, preserving food freshness and saving energy.

NuMaker-M55M1

1. Vibration Detection

Leveraging the M55M1's high-precision analog-to-digital converter and data processing capabilities, it can monitor vibrations produced by the refrigerator during operation. This is crucial for detecting potential mechanical issues such as compressor failure or cooling system instability early. Predictive maintenance can proactively address problems, reducing repair costs and improving the refrigerator's reliability.



2. Sensor Fusion

The M55M1 can simultaneously process data from multiple sensors, including temperature, humidity, light, and door sensors. This sensor fusion enables the smart refrigerator to monitor and adjust its internal environment more accurately, ensuring food freshness and safety. For instance, the system can trigger an alert if the internal temperature rises or the door is left open for an extended period.


3. Biometric Recognition

Utilizing the M55M1's image processing capabilities and machine learning algorithms, the smart refrigerator can incorporate facial recognition functionality. This can be used for personalized user experiences, such as displaying recipes or shopping lists based on individual preferences. This biometric technology can also enhance home security by preventing children from tampering with the refrigerator.



4. Object Classification

Combining a high-resolution camera with the M55M1's powerful processing capabilities, the smart refrigerator can automatically classify and manage items within the fridge. The system can identify and track food types through image recognition techniques, recording their purchase and expiration dates. This helps reduce food waste while providing users convenient inventory management and shopping reminders.

More to explore:

Top